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Abstract —We address the problem of recovering a sparse 
signal observed by a resource constrained wireless sensor network 
under channel fading. Sparse random matrices are exploited to 
reduce the communication cost in forwarding information to a 
fusion center. The presence of channel fading leads to inhomo¬ 
geneity and non Gaussian statistics in the effective measurement 
matrix that relates the measurements collected at the fusion 
center and the sparse signal being observed. We analyze the 
impact of channel fading on nonunifonn recovery of a given 
sparse signal by leveraging the properties of heavy-tailed random 
matrices. We quantify the additional number of measurements 
required to ensure reliable signal recovery in the presence of 
nonidentical fading channels compared to that is required with 
identical Gaussian channels. Our analysis provides insights into 
how to control the probability of sensor transmissions at each 
node based on the channel fading statistics in order to minimize 
the number of measurements collected at the fusion center 
for reliable sparse signal recovery. We further discuss recovery 
guarantees of a given sparse signal with any random projection 
matrix where the elements are sub-exponential with a given sub¬ 
exponential norm. Numerical results are provided to corroborate 
the theoretical findings. 

EDICS; ADEL-DIP, CNS-SPDCN 

I. Introduction 

Consider a wireless sensor network (WSN) deployed to 
observe a compressible signal. The goal is to reconstruct the 
observed signal at a distant fusion center utilizing available 
network resources efficiently. In order to reduce the energy 
consumption while forwarding observations to a fusion center, 
some preprocessing is desired so that the fusion center has 
access to only informative data just querying only a subset 
of sensors. Use of compressive sensing (CS) techniques for 
compressible data processing in wireless sensor networks has 
attracted attention in the recent literature Q-ini. In Q, 
the authors have proposed a multiple access channel (MAC) 
communication architecture so that the fusion center receives 
a compressed version (represented by a low dimensional linear 
transformation) of the original signal observed at multiple 
nodes. According to that model, the corresponding linear 
operator is a dense random matrix. Thus, almost all the sensors 
in the network have to participate in forwarding observations 
consuming a large amount of energy. The application of sparse 
random matrices to reduce the communication burden for 
wireless compressive sensing (WCS) has been addressed by 
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several authors Gi-ii so that not all the sensors forward 
observations. In im, the authors provide a probabilistic sensor 
management scheme for target tracking in a WSN exploiting 
sparse random matrices. In these approaches, the sparse ran¬ 
dom matrix is considered to be a sparse Rademacher matrix 
in which elements may take values (+1,0,—1) with desired 
probabilities. The use of sparse random matrices instead of 
dense matrices in signal recovery in a general framework (not 
necessarily in sensor networks) has been further discussed in 
several works iH-iini. 

In practical communication networks, the communication 
channels between sensor nodes and the fusion center undergo 
fading. The presence of fading affects the recovery capabilities 
since it leads to inhomogeneity and non Gaussian statistics in 
measurement matrices. In a, the problem of sparse signal 
recovery in the presence of fading is addressed where the au¬ 
thors provide uniform recovery guarantees based on restricted 
isometry property (RIP) considering sparse Bernoulli matri¬ 
ces. Two kinds of recovery guarantees with low dimensional 
random projection matrices are widely discussed in the CS 
literature ESl-Ea: uniform and nonuniform recovery guar¬ 
antees. A uniform recovery guarantee ensures that for a given 
draw of the random projection matrix, all possible fc-sparse 
signals are recovered with high probability. On the other hand, 
nonuniform recovery guarantee provides the conditions under 
which a given fc-sparse signal (but not any fc-sparse signal as 
considered in uniform recovery) can be reconstructed with a 
given draw of a random measurement matrix. Thus, uniform 
recovery focuses on the worst case recovery guarantees while 
nonuniform recovery captures the typical recovery behavior of 
the measurement matrix. 

In this paper, the goal is to enhance our understanding of 
recovering a given sparse signal with sparse random matrices 
in the presence of channel fading. More specifically, we 
provide lower bounds on the number of measurements that 
should be collected by the fusion center in order to achieve 
nonuniform recovery guarantees with li norm minimization 
based recovery with independent (not necessarily identical) 
channel fading. With sparse random projections, the nodes 
transmit their observations with a certain probability. We 
further discuss how to design probabilities of transmissions by 
each node (equivalently the sparsity parameter of the random 
projection matrix) based on the channel fading statistics so 
that the number of measurements required for signal recovery 
at the fusion center is minimized. 

While the authors in a consider a similar problem of 
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WCS, our analysis is different from that in ||4l in several 
ways. In this paper, we derive nonuniform recovery guarantees 
which require different derivations (not based on RIP) and 
provide better recovery results compared to uniform recov¬ 
ery as considered in H. It is noted that, the RIP measure 
is defined with respect to the worst-possible performance. 
Eventhough RIP analysis adopts a probabilistic point of view, 
the subsequent results tend to be overly restrictive, leading 
to a wide gap between theoretical predictions and actual 
performance ll20l . With a given signal of interest, one can 
obtain stronger results. To that end, nonuniform recovery 
guarantees, as considered in this paper are able to capture 
the typical recovery behavior of the projection matrix leading 
to stronger results. We assume envelope detection at the 
fusion center which is employed in practice in many sensor 
networks. More specifically, we assume that the channel phase 
is corrected to ensure phase coherence which is a widely 
used assumption in the sensor network literature. As discussed 
in ll2^ . ll24ll . this can be achieved by transmitting a pilot 
signal by the fusion center before the sensor transmissions 
to estimate the channel phase. Further, the nonzero elements 
of the sparse matrices are assumed to be Gaussian. Thus, the 
statistics of the low dimensional linear operator that relates 
the input and the output at the fusion center are different 
from that in a. In particular, with the model considered in 
this paper, the elements of the random projection matrix after 
taking channel fading into account reduce to independent but 
nonidentical sub-exponential random variables. To the best of 
our knowledge, nonuniform recovery of a given sparse signal 
with nonidentical sub-exponential (or heavy-tailed) random 
matrices has not been well investigated in the literature. Thus, 
the analysis in this paper further enhances our understanding 
on sparse recovery with sub-exponential random matrices in 
general. Further, we show that the number of measurements 
required to reconstruct a given sparse signal can be reduced by 
designing probabilities of transmission at each node based on 
fading channel statistics. In addition, our results are in general 
not asymptotic while the results in H are asymptotic in nature. 


Our main results are summarized below. In the presence 
of independent channel fading with Rayleigh distribution, we 
show that the nodes should transmit with a probability that is 
inversely proportional to the fading channel statistics (chan¬ 
nel power) in order to reduce the number of measurements 
collected at the fusion center in recovering a given sparse 
signal. With this design of probabilities of transmissions, the 
number of measurements required to re cover a given sparse 
signal with sparsity index k scales as (log Nj where 

2i/^ax 22 /^;^ are the largest and smallest average mean 
power coefficients of Rayleigh fading channels, and N is the 
number of nodes in the network (which is assumed to be the 
same as the dimension of the sparse signal). This says, by 
controlling the probability of transmission based on fading 
channel statistics, the impact of inhomogeneity of the elements 
of the measurement matrix on signal recovery can be reduced 
leading to better recovery guarantees. In the special case where 
the fading channels are assumed to be identical and all the 
nodes transmit with the same probability (say 0 < 7 < 1), we 


show that O^-^logiV^ MAC transmissions are sufficient 
to recover a given sparse signal. We further, provide detailed 
analysis on recovery guarantees of a given sparse signal with 
any random projection matrix where the elements are sub¬ 
exponential with a given sub-exponential norm. 

The rest of the paper is organized as follows. In Section 
m the problem formulation is given. Recovery guarantees of 
a given sparse signal under independent channel fading are 
provided in Section |III] We discuss how to design probabilities 
of transmission based on channel fading statistics. Further, the 
results are specified when the fading channels are identical. In 
Section IIVI the conditions under which a given sparse signal 
can be recovered with any sub-exponential random matrix are 
discussed. Numerical results are presented in Section |V] and 
concluding remarks are given in Section IVII 


A. Notation 


The following notation is used throughout the paper. Fower 
case boldface letters, e.g., x are used to denote vectors and 
the j-th element of x is denoted by x(j). Fower case letters 
are used to denote scalars, e.g., x. Both upper case boldface 
letters and boldface symbols are used to denote matrices, e.g., 
A, $. The notations, A^, and A^ are used to denote the i- 
th row, z-th column and the (z,j)-th element of the matrix 
A, respectively. The transpose of a matrix or a vector is 
denoted by (.)^ and (A)^ denotes the Moore-Penrose pseudo 
inverse of A. The notation (g) denotes the outer product of 
two vectors. Upper case letters with calligraphic font, e.g., S, 
are used to denote sets. The Ip norm of a vector x is denoted 
by ||x||p. The spectral norm of a matrix A is denoted by 
||A||. We use the notation |.| to denote the absolute value of 
a scalar, as well as the cardinality of a set. We use to 
denote the identity matrix of dimension N (we avoid using 
subscript when there is no ambiguity). A diagonal matrix in 
which the main diagonal consists of the vector x is denoted by 
diag(x). By Sniin(A) and Sniax(A), we denote the minimum 
and maximum singular values, respectively, of the matrix A. 
The notation Rayleigh((T) denotes that a random variable 
X has a Rayleigh distribution with the probability density 
function (pdf) f{x) = for x > 0. The notation 

X ~ cr^) denotes that the random variable x is distributed 

as Gaussian with the pdf f{x) = 




VTti 


II. Problem Formulation 
A. Observation model 

Consider a distributed sensor network measuring compress¬ 
ible (sparse) data using N number of nodes. The observa¬ 
tion collected at the z-th sensor node is denoted by Xi for 
z = 0,1, • • • , A — 1. Fet X = [xo, ■ ■ ■ , xn-iY be the 
vector containing all the measurements of sensors. Sparsity 
is a common characteristic observed with the data collected 
in sensor networks. The sparsity may appear as an inherent 
property of the signal being observed by multiple sensors, 
e.g., most acoustic data has a sparse representation in Fourier 
domain. On the other hand, not all the observations collected 
at nodes are informative; for example, the sensors located 
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far away from the phenomenon being observed may contain 
poor observations making the observation vector x sparse in 
the canonical basis. In a general framework, assume that the 
signal X is sparse in some basis One of the fundamental 
tasks in many sensor networking applications is to reconstruct 
the signal observed by nodes at a distant fusion center. Due 
to inherent resource constraints in sensor networks, it is 
desirable that sensors use only small amount of energy and low 
bandwidth while forwarding information to the fusion center. 
With recent advances in the theory of CS, WCS with random 
measurement matrices is becoming attractive. A compressed 
version of x can be transmitted to a fusion sensor exploiting 
coherent transmission schemes developed for sensor networks 

m. 

Consider that the j-th sensor multiplies its observation 
during the i-th transmission by which is a scalar (to be 
defined later). All the nodes transmit their scaled observations 
coherently using M (time or frequency) slots. In this paper, 
we consider the amplify-and-forward (AF) approach for sensor 
transmissions. It is noted that a digital approach can be used 
where we digitize the observation into bits, possibly apply 
channel coding, and then use digital modulation schemes to 
transmit the data, for example, as considered in ll25]l . However, 
as shown in for a single Gaussian source with an AWGN 
channel, the AF approach is optimal. Analog transmission 
schemes over MAC for detection and estimation using WSN 
have been widely investigated, for example, in 
Thus, we restrict our analysis in this paper to analog transmis¬ 
sion, while digital modulated signals will be considered in a 
future work. We further assume that the channels between the 
sensors and the fusion center undergo flat fading. We further 
assume phase coherent reception, thus the effect of fading is 
reflected as a scalar multiplication. The received signal at the 
fusion center with the i-th MAC transmission is given by, 

Af-l 

Vi — ^ ^ ^ij ^ij Ui (1) 

i=o 

for i = 0,1,-- - ,M — 1 where hij is the channel coefficient 
for the channel between the j-th sensor and the fusion center 
during the i-th transmission and Vi is the additive noise with 
mean zero and variance cr^. 

Due to energy constraints in sensor networks, we consider 
a scenario where not all the nodes transmit during each MAC 
transmission. To achieve this, is selected as: 

A _ / with prob 

\ 0 with prob 1 - 

where Oy ~ A/'(0,cr|) and 0 < < 1 is the probability 

of transmission of the j-th node. The average power used 
by the j-th sensor during the i-th MAC transmission is 
E{A^^} = 7 jcrj which is assumed to be less than Ej where 
Ej is determined based on the available energy at the j-th 
node. We assume that the j-th node uses the same transmit 
power on an average during all MAC transmissions. Let A be 
a M X N matrix in which (i, j)-th element is given by Ay 
as in ©. Further, let H be a M x iV matrix in which {i, j)-th 
element is given by hij. With vector-matrix notation, O can 


be written as, 


y = Bx -b V (3) 

where B = H © A, © is the Hadamard (element-wise) 
product, y = [ya,--- ,yM-iV and v = [ uq ,--- ,vm-iV- 
Let 7 = [ 70 ,-•• , 7 Ar_i]^. The vector 7 is used to refer to 
the measurement sparsity of the matrix B or equivalently the 
probabilities of transmission of all the nodes. The goal is to 
recover x based on Q. One of the widely used approaches for 
sparse recovery is to solve the following optimization problem 

ED: 


min||x||i such that y = Bx (4) 

X 

with no noise, or 

min||x||i such that ||y — Bx ||2 < (5) 

X 

with noise where e„ bounds the size of the noise term v. 

It is noted that, when 7 j = 1 and (t| = cr^ for all j, 
the elements of A are independent and identically distributed 
(iid) Gaussian with mean zero and variance cr^. Then, if we 
further assume AWGN channels so that B = A, B is a 
random matrix with iid Gaussian random variables. Sparse 
signal recovery with iid Gaussian random matrices has been 
extensively studied EQI, ED- Under fading, the matrix A 
is multiplied (element-wise) by another random matrix H 
which has independent and nonidentical elements. Thus, the 
recovery capability of (IDi (or (ID) depends on the properties 
of the matrix B = H © A. In this paper, we assume that 
the fading coefficients /ly are independent Rayleigh random 
variables with hij ~ Rayleigh(z/j) for i = 0, • • • ,M — 1 and 
j = 0,1, • • • ,N — 1 where } = 2z/| is assumed to be 
different in general for the channels between different sensors 
and the fusion center. The goal is to obtain recovery guarantees 
of a given x based on (|4]i under the above discussed statistics 
for A and H. 

First, it is important to observe the statistical properties of 
the matrix B. 


B. Statistics of B 

The (i, j)-th element of B is given by, 

_ _ J hijUij with prob 7 ^ 

0 with prob 1 — jj 

for i = 0, • • • , M—1 and j = 0, • • • , N—1. Since the elements 
of A and H are assumed to be independent, the elements of 
B are also independent (but not identical in general). 

Proposition 1. Let w = hijOij where Uij ~ and 

hij ^ Rayleigh Then the pdf of w is doubly exponential 
(Laplacian) which is given by, 

where d = VhO'a- 

Proof: See Appendix A. ■ 
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Taking aj = (TjUj, the pdf of u — in Q can be written 
as 

/(m) =7i^e”^+ (1-7 j)5(m) (7) 

where 6{.) is the Dirac delta function. It can be easily proved 
that 


Pr{\u\ > t) = 


1 for t = 0 

_ t 

-fje for t > 0 

Thus, we can find a constant Ki > 0 such that, 

Pri\u\ >t)< 


for all t > 0. Thus, M is a sub-exponential random variable 
(Eo). In other words, the elements of B are independent (but 
not identical in general) sub-exponential random variables. 
While there is a substantial amount of work in the literature 
that addresses the problem of sparse signal recovery with 
Gaussian and sub-Gaussian random matrices, very little is 
known with random matrices with sub-exponential (or heavy 
tailed) elements. In the following, we obtain nonuniform 
recovery guarantees for (|4]i when the elements of B have a pdf 
as given in (|7]i and simplify the results when the matrix B is 
isotropic. We further provide recovery guarantees for general 
nonidentical sub-exponential random matrices. 


III. Nonuniform Recovery Guarantees with 
Independent Channel Fading 

We present the following statistical results which are helpful 
in deriving recovery conditions. 

Definition 1 (Isotropic random vectors iTOl l. A random vector 
X £ is called isotropic i/E{xx^} = Iat. 

The row vectors of the matrix B are in general not isotropic. 
However, the column vectors of B with appropriate normal¬ 
ization become isotropic. In the special case where jj = 7 
and dj = d, both row and columns vectors of the normalized 
matrix , ^ B are isotropic. 

Proposition 2 (mgf u). Let u be a random variable with pdf 

f{u) where f{u) is given in Then for |f| < - ^ where 

iymax = max{tfj}, we have 
3 

E{e‘“} < 

where r/^ax = max{ 7 ^a^}. 

Proof: See Appendix B. ■ 

Next, we provide a Bernstein-type inequality to bound 
the weighted sum of independent but nonidentical random 
variables with pdf as given in (|7]). It is noted that, a similar 
bound is derived in ll^ for general sub-exponential random 
variables which are characterized by the sub-exponential norm. 
The following results are the same as those in Proposition 5.16 
of only when 7 ^ = 1 for all j. 

Proposition 3 (Bernstein-type inequality ). Let uq, ■ ■ ■ , un-i 
be N independent random variables where the pdf of Uj is 


as given in 0 for j = 0, • • • , — 1. Then for every a = 

(ao, • • • and every t > 0, we have, 


Pr 


N-l 


oiiUi\ > f ) < 2 e 


( t 

* \ “Inmaxllaillo ’ 11 a 11 o 


( 8 ) 


\ i=0 / 

where pmax = max{ 7 j(f 7 and pmax = max.{dj} as defined 
before. 

Proof: See Appendix C. ■ 


A. Nonuniform recovery guarantees in the presence of inde¬ 
pendent fading channels 

In the following, we present our main results on recovery of 
a given x based on (|4]i. Before that, we introduce additional 
notation. Let U — {0,1, • • • ,N— 1} and S := supp(x) = 
{i : x(i) 0 ,i = 0 , 1 , • • • , — 1 } where x(i) is the i-th 

element of x. For a fc-sparse vector x, we have |iS| = k. 
Further, by B5, we denote the sub-matrix of B that contains 
columns of B corresponding to the indices in S and x^ is a 
fc X 1 vector which contains the elements of x corresponding 
to indices in S. Further, let d = [cto,--- ,dN-i]'^ and 1 / = 

Wo, ■ ■ ■ , 

To ensure recovery of a given signal x via (Si, it is sufficient 
to show that Ea, ED, ca, 

|((Bs)'fb/,sgn(x'®))| < 1 for alU £ 5 

where (Bs)t = (B^Bs)-iB^ is the Moore-Penrose pseudo 
inverse of Bg and sgn(x) is the sign vector having entries 

sgn(x), :=( for all j £ Zi. 

^ (0, otherwise, 


Theorem 1. Let S <ZU with |iS| = k. Further, let the elements 
of B be given as in = max h,d^), 

0<j<N-l ^ 

Pmin( 7 , ^)= min {'jjd'^) and = max {dj}. 

Define R such that 


libgiloo 

llbsib 


< R 


almost surely where 0 < i? < 1 and bs = (B^)^sgn(x'®). 
Then, for 0 < e, e' < 1, x is the unique solution to (0 with 
probability exceeding 1 —max(e, e') if the following condition 
is satisfied: 


M > iRax.{Mi, M 2 } (9) 

where Mi and M 2 are given in I liOl ) and MR respectively, 
and c' is an absolute constant. 


Proof: See Appendix D. ■ 

From Theorems it is observed that the ratio between peak 
and total energy of bs, R, plays an important role in deciding 
the minimum number of MAC transmissions needed to recover 
X with a given support S. As shown in Appendix E, when the 
elements of B are distributed according to 0 we can take 
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Ml = 


M, = 


^max 
f?min 




(7 

( 7 ,^) 


^max(^ ) 

^min (7)C>-) I \/?7min(7>cr) 


2fc 


i?log( 27 V/e) + 


lo g(fc/£') 
2 d 


log(fc/e') 

2 d 


( 10 ) 

( 11 ) 


Then, the dominant part of M2 in (fTTl i scales as 


O 


/?7max(7,C^)?7max(o-) 


k\og{ 2 Nldj 


VV ^min(7,Cr) 
while the dominant term of Mi scales as 


O 


^max 


^min 


(0'’^;,log(2iV/e) 


( 7 ,^) 


Thus, when 


min{7i(Ti} < max{7, tT^} 

3 3 


y/max{7jcr2} 


max{CTj 

3 


( 12 ) 


( 13 ) 


(14) 


7i ^ min > 1 


= 7 


for j = 0 , - ■ ■ ,N — 1 . 


When aj = for all j, the term that depends on 7 in M2 
in (Ell can be expressed as. 


^( 7 ) = 


' ? 7 max( 7 , 0 ')i?max('^) 


7?^ • 
/min 


( 7 ,^) 


\ 


max{ 7j }max{ } 
3 •’3 


we select 7 so that the largest 7^ is assigned to the node 
indexed by 0 while the smallest 7^ is assigned to the node 
indexed by TV — 1 for j = 0 ,-- - 1 . More specifically, let 

7j = ^ for j = 0 , • • • , TV — 1 where do is a constant. This 
leads to 


^( 7 ) = 


'N-l 


(17) 


Ml dominates M2 (and vice versa). 

B. Probabilities of transmission and channel fading statistics 

From (fTSl i and (flJl l. it is seen that the number of MAC 
transmissions required for reliable signal recovery depends 
on the probabilities of transmission 7, and the quality of the 
fading channels u. Since the designer has the control on 7, 
we discuss how to design 7 as a function of u so that Mi and 
M2 become minimum with respect to 7. Since > dmin, 
for Ml and M2 to be minimum, it is desired to have the gap 
between p^ax and minimum. When p^ax = dmin, it is 
easily seen that M2 dominates Mi, thus, M = M2. Let us 
assume that the maximum available energy at each node for 
given transmission is the same so that (t| = and Ej = E 
for all j. Then the probability of transmission at each node 
should satisfy the following condition: 

E 


With the constraint for qj in (fTsT l. we further have 

do < fvl- 

Then, 4'(7) in (fTTl i is minimum when do = T^'o- Thus, the 
probabilities of transmission which minimize 4>(7) are given 
by 

,2 


opt 


;r, 0 


ij = 7-2 
J 1.2 


( 18 ) 


for J = 0, • • • , — 1 and the minimum value of 'I'(7) is 

T'(7°p*) = 


‘'N-l 

■ 


With this design of 7, the number of MAC transmissions 
required for reliable signal recovery at the fusion center scales 
as 


M = 0 


^^k\og{2N/€) 


( 19 ) 


where Ci{iy) = 


Thus, the impact of inhomogeneous 


( 15 ) 


^min{ 7 ji/j 


Since < 1 for all j, we have 4 / (7) > 1 and the equality (of 
'11(7) > 1 where 'I'(7) is given in (fTbl l) holds only if 7^ = 1 
for all j and the channels are identical so that = i/f = 
••• The goal is to find 7 so that (fTbl l is minimized 

under the constraint (fTSl l. It is noted that 'I'(7) is minimum 

with respect to 7 when maxljjvf} = inm{jji 3 f}. Without 

3 3 

loss of generality, we sort z/^ ’s in ascending order so that 
,z/jv. To achieve max{7j^} = min{7ji/^}. 


nunjfj} 

3 

channel fading with the optimal design of 7 on M appears as 

the ratio between max{i7 } and min{z/j }. 

3 3 

C. Nonuniform recovery when B is dense 

Here we study the special case where 7^ = 1 for j = 
0 , • • • A^ — 1 so that B is a dense matrix. In this case. Mi in 
( 16)*0 dominates M2 in (EJ- Thus, M = Mi and we have, 

M = 0 {C 2 {iy)k\og{ 2 N/e)) (20) 

max{i.^} ' 


where 02(1^) = 
all j. Note that in 


and we assume aj = ai for 


V\ < V2 < 


j ^ 

this case 7 = 1. From (O and (|20l), 
it is seen that the scaling of M when 7 = 1 is greater 
than that is with a sparse matrix with properly designed 
probabilities transmission since (72(iz) > ( 7 i(zz). This implies 
that, with nonidentical fading channels, it is beneficial to 
use sparse random projections with transmission probabilities 
matched to fading statistics as in (fTSl l compared to the use of 
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dense matrices in order to reduce the total number of MAC 
transmissions. While (l20b provides a scaling, the exact M 
required for reliable sparse signal recovery is illustrated in 
numerical results section (Fig. for dense and sparse matrices 
with nonidentical channels. 

As will be shown in the next section, when the matrix B 
has dense iid elements (so that 7 ^ = 1 for j = 0, - ■ ■ N —1 and 
Vq = ■ ■ ■ = we get M = 0(fclog(2W/e)). From ( fT9] l 

and (I 20 I 1 . it is seen that, the presence of non identical fading 
channels (the inhomogeneity) increases the required number 
of MAC transmissions by a factor of with sparse 

projections and (72 (i^) with dense projections, respectively, 
compared to that required with identical channels. It is further 
worth mentioning that we obtain dominant parts of Mi and 
M 2 as in (foi l and (fT 2 Ti using lower bounds for (fTOl i and (fTTTi . 
respectively. Thus, the impact of Ci{i') and ( 72 (i^) on (fT^ 
and (l 20 l i. respectively, can be scaled versions of them. 

D. Nonuniform recovery when B is isotropic 

Now consider the special case where 7 ^ = y, ifj = a = 
cTaVk for all j. Then, the elements of B are iid random 
variables and the columns and rows of the scaled random 
matrix _ =B are isotropic. From Theorem [T] we have the 

following Corollary. 

Corollary 1. Assume jj = 7 and dj = d for all j. Then when 

M = (7 A iog(2iV/e)) (21) 

X can be uniquely determined based on 0 with high proba¬ 
bility, where 0 < e < 1 A ai defined in Theorem\i\ 

Proof: When 7^ = 7 and dj = d for all j, we have 
??min = ?7max = ^nd p^ax = d. Then, the scaling of 

Ml in (fTsT l reduces to O {k\og{2N/e)) while the scaling of 
M 2 in (fT^ reduces to O log(2A^/e)^0. Since 7 < 1 , M 2 
dominates Mi. ■ 

When 7 = 1 , the matrix B is dense and the elements are 
iid doubly exponential. Then 0{k\og{2N/e)) measurements 
are sufficient for reliable recovery of x. As 7 decreases, 
equivalently when the matrix B becomes more sparse, the 
minimum M required for sparse signal recovery increases. In 
particular, when 7 < 1, the product yk plays an important 
role in determining M. It is noted that yk reflects the average 
number of nonzero coefficients of x that align with the nonzero 
coefficients in each row of the sparse projection matrix B. In 
Table m we summarize the scalings of M required for recovery 
of X in different regimes of yk. In particular, 

• when yk = ro where tq is a constant, we have 7 cx p 
Then, when k is sublinear with respect to N so that k = 
o{N), 0{k^^^ \og{N)) measurements are sufficient for 
reliable recovery of given x. It is noted that this scaling 
is only slightly greater than 0{klog{N)) which is the 
scaling required for a dense matrix with iid elements. 
This observation is intuitive since, when k = o{N), 7 is 
not very small and the matrix B is not ’very’ sparse. On 
the other hand, when k is linear with respect to N so that 


TABLE I: Minimum M in the different regimes of yk 


yk 

Ad when k = o(N) 

Ad when k = B(A^) 

II 

0 

[k^/^ log(A)) 


log(V)) 

yk = eN 

0<e< # 

0 



G(^log(V)) 


k = Q{N), and 7 oc p (7(W^/^ log(A^)) measurements 
are required. 

• when yk = eN with 0 < £ < ;^, it is required to 
have O measurements when k = o{N). 

It is noted that, with this setting we have e < -^ 
and e —0 as A^ — 00 . On the other hand, when 
k = Q{N) and yk = eN with 0 < e < ■^, M should be 
scaled as O (^^\og{N)j. With this setting e < 0(1), 
thus, 0{N log(W)) measurements are needed for reliable 
recovery of x. 

1) Design of 7 under total network energy constraints: 
For given M, the average energy required by the network to 
achieve complete sparse signal recovery in the presence of iid 
fading channels is given by, 

Ereq = MyNdl. 

For complete signal recovery with probability at least 1 — e, 
we should have 

M > Co-^ log(27V/e) 

V 7 

where (7o is a constant. Then, we have, 

Ereq>VlCiialkN\og{2Nle). ( 22 ) 

Assume that the network is subject to a total energy constraint 
so that we have to make sure, 

Ereq E. 

Then, 7 should satisfy the following constraint: 

IV. Nonuniform Recovery Guarantees with 
General Sub-exponential Matrices 
In the following, we consider recovering x from y = Bx+v 
when the elements of B are general sub-exponential random 
variables and the rows of B are non-isotropic. 

First, let us define the sub-exponential norm of a sub¬ 
exponential random variable which will be helpful in the 
following analysis. 

Definition 2 (sub-exponential norm fSOj). Let x be a sub¬ 
exponential random variable. The sub-exponential norm of x, 
||x||.0j, is defined by 

||x||^, =sup i(E{|xr})i/L 

p>i p 

Further, let us assume that the each row of B has the 
same second moment matrix E^. Then, we have the following 
Theorem. 
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Theorem 2. Let x be a k-sparse vector with the support set S 
and the matrix B contain independent sub-exponential random 
variables. Let Pmax denotes the maximum sub-exponential 
norm over all the realizations. Further, assume that rows 
of B, Bi’s have the same second moment matrix S b and 
||B,||2 < s/Tq almost surely for all i. Let Amin denote the 
minimum eigenvalue of Then, when the number of 

measurements 


M > 



(23) 


(13 provides the unique solution for x with a given support S 
with probability exceeding 1 — max(ei, df) where 


Pi = min 


/ 1 / Cl ~ _ Cl_ 

\ Pmax Y log(2iV/ei) 

Pmax^l log(2iV/ei) 


and Ri is defined such that < Ri almost surely, and 

bs = (Bg)^sgn(x‘^) as defined before. 


Proof: See Appendix F. 

The dominant part of M in (l23T l scales as 


M = 0 


Pn 


An 


^fc/3i(iV) 


where 

log(2jV/ei) Rl log"(2jV/ei) 

Cl ’ cl 

Then, (HJi provides a unique solution for x with high proba¬ 
bility if 

o(^i;l„g(2iv/n)) iJR,<o(:^) 

Thus, it is observed that, a threshold on i?i, the maximum 
peak-to-average energy of bg over all S plays an important 
role in determining the number of compressive measurements 
required for reliable sparse signal recovery with random ma¬ 
trices with general sub-exponential random variables. 



Pi{N) = max 


V. Numerical Results 

In this section, we provide numerical results to illustrate 
the performance of sparse signal recovery in the presence of 
fading. We consider that the nonzero entries of x are drawn 
from a uniform distribution in the range [—20, —10] U [10, 20]. 
For numerical results, the primal-dual interior point method is 
used to solve for x in (HI while (|5]l is solved after converting to 
the second-order cone program as presented in . In Figures 
[Hill the problem posed in (|4]i is considered where the noise 
power at the fusion center is assumed to be zero. 


A. iid fading channels and identical measurement sparsity 
parameters 

First, we assume that = 7 and Uj = for 

j = 0, • • • , — 1. The performance metric is taken as MSB 

which is defined as. 


MSE = E 


x-x 


2 


(25) 


N=100, k=10, cj^=1,v^=1 
’ ’ a ’ h 



Fig. 1: MSB vs number of MAC transmissions with iid fading 
channels 



Big. 2; MSB vs measurement sparsity index 7 with iid fading 
channels 


where x is the estimated signal. 

In Bigs. [T] and m the MSB vs number of MAC transmissions 
M and the measurement sparsity index 7, respectively is 
plotted for W = 100, /c = 10, cr^ = 1 and = 1. We further 
plot the performance in the absence of fading; i.e. assuming 
AWGN channels so that B = A. It is observed form both Bigs. 
[T] and [ 2 ] that when 7 is not very small, (i.e. when B is not 
very sparse), the impact of fading in recovering a given signal 
is not significant compared to that with AWGN channels. 
It is noted that the statistical properties of the measurement 
matrix changes from light-tailed to heavy-tailed when channels 
change from AWGN to Rayleigh fading. However, as M 
and 7 increase, there is no significant difference in recovery 
performance with both types of channels. Big. [2] illustrates 
the trade-off between M and 7. It is seen that as 7 increases 
beyond Ri 0.3, the MSB performance decreases slowly with 7 
for all values of M. This corroborates the theoretical results 





























N=100, k=10, 0 “^=! 


N=100, k=10, 0=1 



Fig. 3: MSE vs number of MAC transmissions with noniden¬ 
tical fading channels; tr^ = 1, Vj G [1,10] for all j, N = 100, 
A: = 10 


in (I2TI 1 in which the required number of MAC transmissions 
that enable recovery of x based on (jUi is proportional to 

B. Nonidentical fading channels and identical measurement 
sparsity parameters 

Next, we consider the case where fading channels are 
independent but nonidentical and the measurement sparsity 
parameter and the power at the each node are the same over all 
the nodes; i.e. 7^ = 7 and cr| = for all j = 0, • • • ,N — 1. 
Each Uj is selected uniformly from [r'min, J^max] ■ E is noted 
that under this case, the elements of the matrix A are iid but 
those in B are non iid. In Eig. [2 we plot the MSE vs M. We 
let i/rain = E r'max = 10, fc = 10 and N = 100. In contrast 
to Eig. [T] with iid fading channels, it can be seen from Eig. 
[2 that the presence of nonidentical fading channels reduces 
the capability of sparse recovery quite significantly compared 
to AWGN channels even when the matrices are dense (i.e. 
7 = 1). The reason is that, under this case all the nodes 
transmit with equal probability irrespective of the quality of the 
fading channels leading to an inhomogeneous measurement 
matrix. On the other hand, with AWGN, the quality of all the 
channels is identical and the matrix A is isotropic. This will 
be further discussed in the next section. 

C. Nonidentical fading channels and different measurement 
sparsity parameters 

In this section, we consider the case where cr? = cr^, and 
vfs, are selected uniformly from t'max] and arranged 

in ascending order for j = — 1. The values for 

7j’s are selected as in (fTSl l so that the number of MAC 
transmissions is minimum with respect to 7. We further 
assume ^ = 1 so that 7 = 1 in (fTSl l. In Eig. |4] we plot 
the MSE vs M with 7°?*. We further plot the performance 
with 7j = 1 for all j considering both AWGN and fading 



Eig. 5: MSE vs number of MAC transmissions with noniden¬ 
tical fading channels and noise; cr^ = 1, iV = 100, k = 10, 

Z^min — Z^max — 10 


channels. In Eig. Ufa) we let z/min = 1 and z/max = 10 
while in Eig. HJb), we have z.^min = 1 and z/max = 5. We 
make several important observation here. When jj = 1 and 
(t| = tr^ for all j, A is a iid Gaussian matrix, and H is 
a nonidentical (but independent) dense matrix with Rayleigh 
random variables. In that case, as seen in Eig.|4], the recovery 
performance with B = A © H (shown in blue dash line) is 
significantly degraded compared to that with only A (shown 
in red marked dash-dot line) due to the inhomogeneity of 
the matrix B. This corroborates the theoretical results shown 
in Section IIII-CI When the matrix A is made sparse with 
sparsity parameters as in dH, it can be seen that, recovery 
performance (blue marked solid line) comparable to AWGN 
can be achieved especially the ratio is small. Eurther, 

^min 

when the transmission probabilities are selected independent 
of ufs (i.e. randomly) in the presence of nonidentical channel 
fading, a larger number of MAC transmissions is necessary 
to achieve negligible MSE compared to having only AWGN 
channels. When M is small, it is observed that MSE with 
random 7 is slightly smaller than that with optimal gamma 
as found in (fTsT l. It is worth mentioning that M is optimized 
over 7 considering perfect signal recovery and this optimality 
may not hold when M is very small (i.e. in the region where 
reliable signal recovery is not guaranteed irrespective of 7). 

In Eigures [Tllll we assumed that the noise power at the 
fusion center is zero and the recovery is performed based 
on @. In Eig. 0 we consider the problem given in (0) 
where the observations at the fusion center are noisy. Different 
values for the noise variance cr^ are considered and e„ is 

selected such that e„ = d 1 + 2\/2 /s/M lf32 . As 

expected, it is observed from Eig. 0 that as increases, the 
recovery performance is degraded irrespective of the value 
of 7. However, the use of optimal jj, which is obtained in 
(m considering the noiseless case, improves the recovery 
performance even when there is noise compared to the case 
where each node transmits with arbitrary 7^ for all j. 
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N=100. k=10, a^=1 
a 




(b) ^'min — I 5 ^^max — 5 


Fig. 4: MSE vs number of MAC transmissions with nonidentical fading channels; cr^ = 1, = 100, = 10 


VI. Conclusion 

In this paper, we considered the problem of sparse signal 
recovery in a distributed sensor network using sparse random 
matrices. Assuming that the channels between the sensors 
and the fusion center undergo fading, we derived sufficient 
conditions that should be satisfied by the number of MAC 
transmissions to ensure recovery of a given fc-sparse signal (i.e. 
for nonuniform recovery). The impact of channel fading makes 
the corresponding random projection matrix heavy tailed with 
non identical elements compared to the widely used random 
matrices in the context of CS which are light tailed (sub- 
Gaussian). We have exploited the properties of subexponen¬ 
tial random matrices with nonidentical elements in deriving 
nonuniform recovery guarantees under these conditions. We 
have shown that, when the channels undergo independent and 
nonidentical fading, by properly designing the probabilities of 
transmission at each node based on fading channel statistics, 
the number of measurements required for signal recovery can 
be reduced. We further provided recovery guarantees of a 
given sparse signal when the projection matrix is nonidentical 
sub-exponential in general. An interesting future work is to 
investigate the impact of channel interference on sparse signal 
recovery in distributed networks. 


Appendix A 


Proof of Proposition Q] 

Let w = ha where we omit the subscripts of h and a for 
brevity. The pdf of w is given by. 


/M = / —e 


oo '-’h 


h 

.r2 ' 


1 1 1 


Since h > 0, (l26l l reduces to, 
fiw) = 


1 1 




a Jo 


(26) 


Using the relation, e ^ = 5 v/?® cijb > 0, 

we have, 

f{w) = —e 
Za 

where d = UaCth, which completes the proof. 

Appendix B 


Proof of Proposition |2] 

When the pdf of u is as given in (|7]i, we have. 



When If I < it can be shown that 

I I — o-j ’ 


E{e‘“} = l + 7,—(27) 

1 aji 

This holds for any dj with \t\ < } • Thus, when P < 

^3!—, based on geometric series formula, we have ,^‘ 2^2 = 

^max ^ 

Thus, (IZTl i can be approximated by, 

OO 

E{e‘“} = l + 

fc =0 

a; 1-1- 7jcr|f^ < 

where pmax = tR&x{'yjd^}, completing the proof. 

X J 
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Appendix C 

Proof of Proposition Q 

Let A = Then, using exponential Markov 

inequality, we have 

Pr{A >t) = Pr{e^^ > e^‘) < e-^‘E{e^^} 

(28) 


It is noted that 


= e 


Pr{K > t) < e 


fim< -^ 

4r7max I 


x\\? ' STjmax 1 1 at 11 CO 


M-1 


= Pr\\}_^ &i(j)[(B^)*sgn(x")](j)| > 1 

j=o 


2g \ 4Tjinaxl|t>5l!| ’ STjmax 11 11 c 

where we define bs = (B^)*sgn(x‘®) and pmax and pmax are 
as defined in Proposition [2] Thus, we have 


(30) 


— iniii -TiTr=-TTr—iT 

A^ 2 e ^"’maxl|b 5 || 

For Pe in (l30l l to be less than e, we have to have, 
1 1 


, 4pniax| |bs 1 12 2T)niax| |b5 11( 

We can see that OTl i is satisfied when, 

1 


and 


|bs ||2 < 


llbsiloo < 


2\/i7 max log( 2 iV/e) 
1 

max log(2Af/e)' 


||bs ||2 


is the ratio between peak and total 


energy of bs for given S. Let < R where 0 < i? < 1. 

Thus, ( ISTT i is satisfied when 

||bs||2<min 


1 


2v^ max log(2iV/e) 277 n 


Let /3 = min 


,i?log(2iV/e)^ 

1. To have 


■ (32) 


From Proposition |2] we have, 

Pr{A >t)< 

when |A| < 

-. Following similar steps as in the proof 
of Proposition 5.16 in ll^ . we get. 


The same bound is obtained for Pr{—A > t). Thus, we get 

ill. 

Appendix D 

Proof of Theorem [7] 

Proof: (Theorem [T]i We follow similar proof techniques 
developed for nonuniform recovery with sub-Gaussian ma¬ 
trices in Ea with appropriate modifications to deal with 
sub-exponential random variables. The failure probability of 
recovery of x based on (HI is bounded by 

Pe := Pr(3/^5|((Bs)^b,,sgn(x®))| > 1) 

< {N - k)P[ < NP[ (29) 

where = Pr(|((Bs)^bi,sgn(x'®))| > 1 ). 

To bound P[, we use Proposition |3] Conditioned on Bs, 
for given I we have, 

P' = Pr(|((Bs)^b 7 ,sgn(x^))| > 1) 

= Pr(|(b 7 ,(B^)*sgn(x^))|>l) 


^ 2 v'r 7 maxlog( 2 Af/e)’ log(27V/e) ^ 

Pi"(||bs ||2 < f3) > 1 — e' for 0 < e' < 1 , we have to have, 
T‘i’(libsii 2 > /3) < e'- To compute P 2 = Pr(||bs ||2 > P), 
we use the following theorem. 

Theorem 3 ( ll30l ). Let A be a M X k matrix whose rows 
Ai’s are independent random vectors in K.^ with the common 
second moment matrix E = E{ 0 A.^}. Let Tq be a number 
such that ||Ai ||2 < a/Tq almost surely for all i. Then for every 
f > 0 , the following inequality holds with probability at least 
1 - fee-""*' 

II^A^A - E|| < max{||E||i/2b,(52} 

where d = cind c" > 0 is an absolute constant. 

Equivalently, we have, 

-ts/% < Smin(A) < Smax(A) 

<\\Y.\\^/^s/M+ t^J% (33) 

with probability at least 1 — ke~‘^ * . Further, when Tq = 
Ofk), I l33l ) reduces to 

\\Y.\\^/'^s/M -tVk < Smin(A) < Smax(A) 

+ ts/k (34) 

with probability at least 1 — ke~’^ * where c' is a constant. 


Let Bs = FsBs where Fs = 




jS. 


and 7 s, 


(similarly as ) corresponds to 7 ^ where i = Sj is the j-th 
element of S for j = 0, • • • ,k — 1 and z can take any value 
from 0, • • • , A — 1. It is noted that P 2 can be bounded by 


< Pr 


= Pr 



.(Bs) < Fs 


yp 
/3 , 


> log(2A/e). (31) 


Let Esg = E{(Bs)i 0 (Bs)i} be the second moment matrix 
of (Bs)i where (Bs)i is the z-th row of the matrix Bs. Then, 
we have Es^ = r|diag([ 27 SoCT|^, • • • , 27 s,_ict|^_ J^). 
Since E{||(Bs)i|| 2 }^^^ = Vk, we can take Tq = 0{k) where 
To is a number such that ||(Bs)i ||2 < s/Tq almost surely for 
all z. Thus, from Theorem [3l we have, 

Pr (s„,i„(Bs) < 

where d is a constant. Letting t = 

f for P 2 < e', it is required 


that. 



Fs 


f) (35) 
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After a simple manipulation, it can be shown that ( l35T l reduces 
to 


> 


1 


k - ||Eb||1/2 fj 

Using the relations, 


rs , /log(fc/e') 


max(273(TA 


< Ts < 


(36) 

and 


min(27jO-A 




I mm( 27 j (t|) 

max(27j5-U ’ 


is satisfied when 


M 

T ^ 


^max 


Vn 




log(fc/e') 


d 


(37) 


where we define pmax = max(jjaj) and pmin = iniii(7jcr|). 


When f3 = 


=, (IJTI i reduces to. 


2-y/I7max log(2Af/e) ’ 

M > (j^!l^^\og{2N/e) + 

^min \ V ^min \ C I 

On the other hand, when /3 = 2Wxfliog(2jv/.) - have. 


M > [ ^/^7max ^iog(2jy/g) 

?7min y V^min 

completing the proof. 


log(fc/e') 


Appendix E 


We have 


llbsll^ = (sgn(x"))^(B^B5)-^sgn(x") 

l.y. 1 


with sufficiently large M. Thus, 

l|bs||2 > 


2Mpmax 

With sufficiently large M, the i-th element of bg can be 
approximated by. 


M 2jS O'q 

j=0 Sj 


Thus, we have. 




;^2 ■ 


M 275 . (To 

j=0 E 


It is noted that E{|(B5)ij|} = - Thus, 

Eiib.wi} < 

j=0 ^ 


< 


2Mfi^j 

where rymin = min{CTj}. Then we have. 


Thus, R can be considered to be 



Appendix F 


Proof of Theorem 

We follow a similar approach as in the proof of Theorem 
[T] in Appendix D. For a given support set S, the failure 
probability in recovering x from (|4]i is upper bounded by, 

Pe < NPi (38) 

where Pi = Pr(|((B5)^b;,sgn(x'®))| > 1). Using Proposi¬ 
tion 5.16 in ESI, Pi can be upper bounded by. 


— Cl min 

Pi < 2e 


’ pSiriTbsTT 


where ci is a constant and bs = (Bg)*sgn(x^) as defined in 
Appendix D. Then, P^ in ES) c™ be bounded above by ei if 


Pmaxllbslli’ Pmaxllbsllc 


> -log(2iV/ei). 
Cl 


(39) 


Fet the matrix B be such that for any given S, < Ri 

almost surely where 0 < i?i < 1. Then, ( l39b is satisfied when. 


I|b5|| 2 < min 


/ 1 / Cl ~ _ Cl_ 

\ Praax Y log(2W/ei) ’ Pmax7?i log(2Af/ei) 


(40) 


Fet Pi - min \/ log(2Af/ei) ’ Pmaxfll l7(2N/ei)^ ■ We 

have. 


^^(llbslb > Pi) < Pr 


^'5min(Bs) ^ 



Using the Theorem |3] we get, 

Pr{s^in{Bs) < \\E■B,\\^/^^/M-tl/Ih) < 


where Tq is a number such that ||(B5)i||2 < y/To for all i 
and di is a constant. Fetting t = ^||Sbs|7^ — 

it can be shown that Pr(||bs||2 > Pi) < e'l when 


M > 


1 ( , To'^ogfk/e'l) 


II^Bs 


/3i 


+ 


Cl 


Thus, (l4ni is satisfied when. 


1 Vk ^ To\og{k/e'i) 


M > - - + 


Ami 


/3i 


c'l 


(41) 


Efllbsll 00 \ ^ max ^ y/k 

I iibsii2 j - “ v^' 


where Amin is the minimum eigenvalue of SgSs completing 
the proof. 
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